PERSISTENT AND SUSCEPTIBLE BACTERIA WITH INDIVIDUAL DEATHS 
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fSJ Abstract. The aim of this paper is to study two models for a bacterial population subject to antibiotic 

treatments. It is known that some bacteria are sensitive to antibiotics. These bacteria are in a state called 
C " persistence and each bacterium can switch from this state to a non-persistent (or susceptible) state and back. 

Our models extend those introduced in \E\ by adding a (random) natural life cycle for each bacterium and by 
I > allowing bacteria in the susceptible state to escape the action of the antibiotics with a fixed probability 1 — p 

O (while every bacterium in a persistent state survives with probability 1). In the first model we "inject" the 

antibiotics in the system at fixed, deterministic times while in the second one the time intervals are random. 
We show that, in order to kill eventually the whole bacterial population, these time intervals cannot be "too 
large". The maximum admissible length is increasing with respect to p and it decreases rapidly when p < 1. 
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Ci 1. Introduction 

B , 

I— ' It is well known that some bacteria are not sensitive to antibiotics (see @]). This state, called persistence^ 

fS| is not permanent and each bacterium can switch during its lifetime from persistent to susceptible and back 

to persistent many times (see for instance In the persistent state it does not reproduce, while in the 

susceptible state it breeds but it is also vulnerable to antibiotics. 

Two models for this phenomenon have been introduced in [6] . The aim of this paper is to extend these two 
models by adding (1) a life cycle for each bacterium (that is, individual deaths) and (2) a possibly positive 
CNJ probability 1 — p for each bacterium in the susceptible state to survive the action of the antibiotic. In our 

• • models each bacterium has an independent random lifetime represented by two geometrically distributed 

random variables with parameters d„ and dr for the susceptible state and the persistent state respectively. 
At certain times, that we call mass killing times or simply killing times, an antibiotic is injected in the 
system; the time intervals are deterministic and equally spaced in the first model and random in the second 
one. The action of the antibiotic does not affect the persistent population but it kills each bacterium in 
the susceptible state independently with probability p e [0, 1]; p = means that there is no target for the 
antibiotic in the bacterial genome, p = 1 means that the antibiotic performs a "perfect" mass-killing action 
in the susceptible state population. The models in [B] can be recovered by setting dn — dr = and p = 1. 



X 



For some values of the parameters (see Section 2.1 for details), the system dies out almost surely even 



without the action of the antibiotics; thus, we need to study only the so-called supercritical case, which is 
the case when the natural evolution of the system allows survival with positive probability. 

In the deterministic killing times case we suppose that the mass- killings occur at times 5„ :— nT where 
r > 0. We show that, for every value of the parameters, if the interval T between each killing time is too 
large (strictly larger than a critical value T^, G (0, +oo)), the bacterial population has a positive probability 



of survival, while if T < Tc there is almost sure extinction (see Theorem 3.1 1. In particular we are interested 
in the dependence of from p: as p converges to 0, the critical time interval length converges to as 
well. Thus there is not a positive minimum time interval which guarantees the extinction of the bacterial 
population for all p £ (0, 1]. In particular when the death rate dr is positive, for some set of parameters 
it might happen that switching from the susceptible to the resistant state is not a good strategy from the 
bacteria point of view, since it results in a longer critical time Tc- 

In the random killing time case we suppose that the mass-killings are separated by a sequence of inde- 
pendent random time intervals {r„}„>i; this sequence is i.i.d. and the distribution is given by a probability 
measure /i^, where {/i/3}^>o is a one-parameter stochastically increasing family of probability measures sat- 
isfying some mild conditions (see Section|4]for details). In this case we have two randomizations, so to speak: 
first we choose a realization of the sequence {r„}„>i (we call ^ a realization of the environment) and then 
we have a random evolution of the system with killing times given by ^. We show that if (3 is large enough 
(/3 > PKp)) the population survives with positive probability for almost every realization of the environment 



see Theorem 4.1). On the other hands if /3 is small enough (/3 < P^{p)) then the population dies out 



almost surely for almost every realization of the environment (see Theorem 4.2). As in the deterministic 
case, limp_>o /3c (p) = 0- Roughly speaking, since the expected time between two consecutive mass-killings 
is a nondecreasing function of /3, we have that, in order to kill almost surely the bacterial population, the 
expected time between two injection of antibiotics in the system cannot be too large. According to Ex- 



ample 4.4 it might happen that P'^{p) < f3l{p)- In particular, if fip ^ Q{l//3) (where G is the geometric 



distribution) then PKp) — Pcip) =• l^c{p) and limp_j.o /3c(p) = 0. 

2. The dynamics 

This is a modification of the model described in BJ with the introduction of individual deaths for each 

type of bacteria; indeed, it is quite natural to assume that each bacterium has its own life cycle in the 

absence of an antibiotic treatment. Another addition to the dynamics is the possibility for some susceptible 

bacteria to survive (with a fixed probability 1 — p where p G [0, 1]) the action of the antibiotics. We denote 

by Nt and R,, the number of susceptible and persistent bacteria respectively. This is a 2-type process in 

continuous time, with the following (nonnegative) rates: 

{Nt, Rt) {Nt + 1, i?t) at rate \Nt 

{Nt, Rt) {Nt -l,Rt + 1) at rate aNt 

{Nt,Rt) {Nt + l,Rt~l) at rate bRt (2.1) 

{Nt,Rt) {Nt-l,Rt) atrated„7Vt 

{Nt,Rt) ^ {Nt,Rt - 1) at rate drRf 

We recall that a change of state takes place at rate a if it takes place after a random geometrically distributed 

time intervals T ^ G{a): due to the lack of memory of the geometric distribution, this means that whenever 

we start looking at the system, the random time to wait before the change of state is a t?(Q;)-distributed 

random variable. In particular the probability of the change of state in an interval of time [t, t + At] is 

asymptotic to a ■ At as At goes to 0. A more precise construction of the model is given in the proof of 



Theorem [4^3} Roughly speaking, we can imagine that each particle has five clocks which ring at geometrically 
distributed time intervals with parameters A, a, b, dn and dr (the clocks are independent). When a particle 
is in a susceptible state we have different possibilities: if its Q {X)-c\ock rings it breeds, if its tJ(c?„)-clock rings 
it dies and if its CJ(a)-clock rings it changes into a persistent state (it is not affected by the other clocks). On 
the other hand when a particle is in a persistent state we observe the following behaviors: if its Q {dr)-clock 
rings it dies and if its CJ(6)-clock rings it moves to a susceptible state (and, again, it is not affected by the 
other clocks). 

When a = and b = the two populations are completely separated, the A^-population is a branching 
process with mass killing and the i?-population is stable if rfj, = or dying out if dj. > 0. If a > and 
6 = then the A^-population is a branching process with mass killing and individual death rate a + d„, while 
the i?-population survives if and only if either dr = or the iV-population survives. The interesting case 
is & > 0. We note that this process is not monotone with respect to the parameters a and 6; on the other 
hand, it is monotone with respect to the other parameters and to the initial condition. 

Without the mass deaths caused by the antibiotics, the process has a discrete-time branching random 
walk counterpart (similar to the one described in [111 [3]). When the antibiotic is injected in the system the 
dynamics is the following 

iNt,Rt) -> (S(7Vt,l-p),i?0 
which means that the number of surviving susceptible bacteria is a binomial-distributed random variable; 
thus, at a killing time each susceptible bacterium is killed (independently from the others) with probability 
p £ [0, 1]. After a mass killing the system performs a new evolution starting from the survivors. If we consider 
just the surviving population at these mass killing times, we have a discrete-time process; it turns out to be 
a 2-type branching process or a 2-type branching process in random environment depending on our choice of 
the killing times (deterministic or random) . Our choice will be either an increasing sequence of killing times 
{5'n}n>i where S'„ — nT (for a fixed T > 0) or = "^n where {r„}„>i is an i.i.d. sequence {Sq :— 0). 

According to [U [71 [3] the long-term behavior of this discrete-time branching process depends only of its 
first-moment matrix M = {mij)ij^i_2- where niij is the expected number of offsprings of type j from a 
particle of type i (see for instance |141 15]). In order to compute M we need to consider the mean field model 
(this is done in Secton 2.1 ). The main results on the deterministic case and the random case are in Sections |3] 
and |4] respectively. We note that all these results hold for any finite (non-void) initial condition. All the 
proofs and technical Lemmas can be found in Section [5] 

2.1. Mean field model. This section is a useful exercise which allows us to obtain some explicit expressions 
the we need in the sequel. The linear system of equations for the expected values (nt,rt) := E[{Nt,Rt)] is 



^nt = (A - a - dn)nt + brt 
^^rt = ant - {b + dr)rt, 



(2.2) 



where 6 > and A, a, dn, dj. > 0. The eigenvalues x^, x (where > x ) of the corresponding matrix 

X — a — d„ b 



A ■— 

' a —{b + dr) 



are the solutions of the equation 

h{x) := x'^ + x{b + dr - X + a + d^) - {{b + d,.)(A - d„) - adr) = 0. (2.3) 

We note immediately that, since h{—{b + rf^)) = h[X — a — d^) = —ab < 0, then the eigenvalues are always 
real numbers and x~ < min( — (fe + d^), A — a — d„) and a;+ > max(— (6 + d^), A — a — c?„) (one of equalities 
holds if and only if both hold, that is, if and only if ab = 0). Moreover, the basic branching process theory 
tells us that if the maximum eigenvalue x"*" < then we have almost sure (spontaneous) extinction. Hence 
if the determinant of the matrix h{0) = —(6 + dr){X — dn) + adr > we have extinction for all p and for any 
choice of {T„}„>i (even when Ti = +oo). From now on we assume 

{b + dr){X- d„) - adr > 0, (2.4) 

that implies immediately x^ > 0; hence x^ > x^ . A corresponding pairs of eigenvectors is Z — (l,a/(b + 
dr + x^)), C — {1, a/ {b + dr + x^)) . The generic solution can be written as 



where := X^i^o-^V*' fo'" every matrix B and (n(0),r(0)) is the initial state. The explicit computations 
of e^* are easy: one simply needs to evaluate the solution of the system starting from (1, 0) and (0, 1). Note 
that x^ + x^ = X — b — dr — dn — a and that x'^x'^ = adr ^ (^ + dr){X — dn). We have 



n{t) 



b±dr±x_\ ^ / h+d,^+x \ 
. x~^ —x~ J \a;+— a;~ / 



[ (x+-x~) \ te+ , [ (X+-X-) 1 tx- 

f{t) ) '~ \ b+d,^ + X- } ^ ~^ \ b+d,-^-r+ I «^ 



(2.5) 



x'^—x I \ x^ —X 



(remember that 6 + ^^ + 2; < 0). We note that X\va.i^^ n{t) — limt_yoo n(t) — +oo; if, in addition, a > 
then limf_i.oo r{t) = limf_i.oo r{t) = +oo. Hence 



note that e^^e^" = e^^^e^* = e^(*+"). 



3. Deterministic mass killing times 



Between killing times, the bacterial population evolves randomly according to the rates (2.1), each time 
starting from the set of survivors of the previous killing time. We choose fixed time intervals T„ = T, where 
r > 0; hence mass killings occur at Sn = nT. We follow the strategy of [6]. For all n > 0, we let the 
system evolve between S'„_i and Sn and we count the number of survivors of each type at time Sn- This is 
a 2-type branching process, whence we have survival if and only if the Perron- Frobenius eigenvalue 7^ of its 
first-moment matrix 



satisfies 7^ > 1 (see |3]). Note that the entries of the j-tli coiumn of the matrix are the average number 
of survivals after a mass kilHng at time T starting from one particle of type j {j — 1 being a susceptible 
particle, j — 2 being a persistent particle). 

The following theorem holds for any (non-void) finite initial condition and the critical time T'c(p) does not 
depend on the initial condition (clearly it depends on all the parameters of the system, even though, here, 
we emphasized only the dependence on p) . 



Theorem 3.1. Let A, a, dm dr > 0, b > such that equation (2.4) holds and a + 1 — p > 0. For any p > 

there exists Tc{p) £ (0, +00) such that the process dies out almost surely if and only if T < Tdp). Moreover 
p Tc{p) is a continuous, strictly increasing function and limp_i.o Tc{p) = 0. 



Requiring the inequality (2.4) is quite natural, since if it does not hold, the bacterial population would 
become extinct almost surely even without the action of the antibiotic. Analogously, ifa + 1— p = (that 
is, p — 1 and a — 0) there cannot be survival since at the first killing time the whole susceptible bacterial 
population is killed and the persistent population decreases (since they cannot reproduce without switching 
to susceptible state and there is no switching back from susceptible to persistent). If p < 1 there can be 
survival even when switching form susceptible to persistent state is forbidden (that is, a = 0). 

Since p T'c(p) is increasing we have that ii t > T'c(l) then there is survival with positive probability for 
all p, while if t e (0,Tc(l)) there is a critical value Pc{t) G (0, 1) such that there is almost sure extinction if 
and only ii p > Pc{t)- 

From the bacteria point of view, a winning strategy is to make Tc as small as possible. Here are three 
plots of Tc where a = b ~ 0.01 and dn = dr = 0.025: the first one on the left is the function (A,p) M- Tc, the 
second one is the function p 1^ Tc (where A ~ 3.7) which show a fast increasing of Tc w.r. to p as p is close to 
1. This means that if the antibiotic is slightly less than perfectly efficient (that is, p < 1) then the maximum 
admissible time interval Tc to kill the bacterial population is rapidly decreasing as p decreases. This is shown 
also by the third plot, which represents the functions A 1— > Tc for P = 1 (red solid line), p = 0.95 (yellow 
dot-dashed line) and p ~ 0.9 (green dashed line). 
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Let us discuss briefly the behavior of Tc w.r. to a, in order to understand if a > is a better strategy than 
a — Q from the bacteria point of view. First of ah, when p = 1 the only hope for survival for the bacterial 
population is when a > 0. On the other hand, of p < 1 there might be a positive probability of survival even 
if a = 0, since a small fraction of susceptible bacteria may survive the action of the antibiotics. Hence in this 
case, it is not trivial to decide whether a > is a better strategy than a = or not. We note that, if > 0, 



then by equation (2.4) we have that a > (A — dn){b + dr)/dr implies a.s. extinction. More precisely one can 
prove that as o — ?> (X — dn){b + dr) /dr then x+ ^ which implies Tc oo (see the proof of Theorem 3.1 for 
details) and eventually the situation becomes less favorable for the bacteria. 



On the other hand, if we rewrite equation (2.3 1 as h[x) — {x + b + rf,.)(a; — A + dn) + ci{x + dj.) we see 
immediately that, when dj. = 0, for every fixed x > (resp. x < 0) h is strictly increasing (resp. decreasing) 
w.r. to a > and h{x) — > +oo (resp. h(x) — oo) as a — > oo. This implies immediately that x~ and x^ are 
strictly decreasing w.r. to a and that x^ — > —oo and x+ — )■ as a — > oo. Hence, when dr = 0, it is easy to 
prove that Tc ^ as a oo (this can be done by checking that, for every fixed i > 0, the function Ft^p(l), 



introduced in the proof of Theorem 3.1 is negative for all a sufficiently large). Here are two series of plots: 



on the left is = and on the right is > while the other parameters, with the exception of p, are fixed: 
p equals 0.9 (green dashed line), 0.95 (yellow dot-dashed line), 0.99 (blue dotted line) and 1 (red solid line). 





We see that if = then the best strategy for the bacterial population is to have a as large as possible. 
If dr > there is a critical value for p, above which, increasing a is a good strategy, up to a suitable value 
which minimizes Tc. Below the critical value for p the best situation for the bacterial population is a = 0. 
As a — >■ oo, eventually the situation becomes worse for the survival of the bacteria for all values of p. 

A more rigorous study of the behavior of Tc with respect to p, a and b is possible but it would exceed the 
aim of this paper. 



4. Random mass killing times 



5.1 



maxj?! : Sn < 



We consider a sequence of i.i.d. positive random times {T'„}„>i. According to Lemma 
t} < +0O a.s. for all t > 0, which means that there are a finite number of killing times in each finite interval 
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almost sm'ely. Morever, suppose that the law of r„ is /i^, where {/i0}^g(o,+oo) is a family of probability 
measures on (0, +00) (stochastically nondecreasing w.r.to /3) satisfying 



(1) Vio>0, lim Ai/3((0,io]) = 0; 

(2) V/3 > 0, := / </i^(di) < +00; 



(4.8) 



(3)Vio>0, lim / t^ip{At) / t^ip{At) 

P^Oj(0,to] ' "'(to, 00) 



Clearly, since the family {M^}^e(o.+oo) is stochastically nondecreasing, we have that /? 1— ?> j^^^ t^p{dt) 
is a nondecreasing function for every to > 0. Moreover, (3) implies 

(4) Vio > 0, hmAi^((0,to]) = 1. 

As an example, consider the family of geometric law 0{l/f3). 

Roughly speaking, in this case, we have two randomizations, first we choose a realization of the random 
sequence of times {T„}„>i (we call it, the environment) and then we consider the random evolution of the 
population with the chosen killing times. More precisely, the sequence of snapshots of the system taken at the 
random times {Sn}n>o is a multitype branching process in random environment (see |13| for the definition). 
For each fixed /3 we call this the /3-process and each realization ^ of the random time sequence {T'i}n>i 
is our environment. Henceforth, when we say that some event A (extinction or survival) has probability 
(resp. > 0) for almost all realizations of the environment, we mean that the conditional probability of 
the event with respect to the realization ^ of the sequence of killing times is (resp. > 0) for almost all 
realizations that is, P(^: ¥{A\T^ = £_,, Vi > 1) = 0) = 1 (resp. F{^: F{A\Ti = ^„ Vi > 1) > 0) = 1). 

Clearly if q(^) = (91 (Oi 92(C)) is the vector of extinction probabilities (starting from one susceptible 
bacterium or from one persistent bacterium respectively), we have that P(<7(C) = 1) is either or 1. This 
means that there is a.s. extinction for almost all realizations of the environment or for almost no realizations 
of the environment. 

Our results hold for any finite (non-void) initial condition (and, again, the critical values depend on all 



the parameters of the system but not on the initial condition). We assume again the inequality (2.4) to 
avoid spontaneous extinction of the bacterial population without the action of the antibiotic. 

The first theorem states that if f3 exceeds some finite critical value there is survival almost surely, 
that is, for almost every realization of the environment. Roughly speaking, since the expected time is 
nondecreasing with respect to /3, it means that if the expected time is too large, the action of the antibiotic 
might not be sufficient to kill the whole bacterial population. 



Theorem 4.1. Let X,a,dn,dr > 0, b > such that equation (2.4) holds. Let {/i^}^g(o,+oo) satisfy equa 



tion (4.8) and a + 1 — p > 0. If l3^{p) := sup{/3 G (0, +00) : the (i-process dies out a.s.} then P].{p) < +00 
and for all (3 > P^ip) we have survival with positive probability for almost all realizations of the environment. 
Moreover p ^ (p) is nondecreasing. 



The second result tells us that if f3 is smaller than some (strictly positive) critical value then, with 
probability 1, the antibiotic will eventually kill the bacterial population. We show that, tends to as p 
tends to 0. 



Theorem 4.2. Let A,a, d„,dr > 0, 5 > such that equation (2.4) holds. Let {M/3},3e(o,+oo) satisfy equa 



tion (4.8|. If j3l(p) :— inf{/3 G (0, +cx)) ; the j3 -process survives with positive probability} then I3'^(p) > 
such that for all j3 < I3'^{p) we have a.s. extinction for almost all realizations of the environment. Moreover, 
p I— > /?c(p) is nondecreasing and infp_yo Pl{p) = 0. 

Sharper results can be obtained if we assume that the random times have a geometric distribution with 
expected value 1//3. In this case there is a unique critical threshold /3c separating almost sure extinction 
from survival with positive probability. 



Theorem 4.3. Let X,dmdj, > 0, a,b > such that equation (2.4) holds and a + l—p > 0.. Let {/i^};3g(o,+oo) 
be a sequence of geometric laws fip ^ Q(l//3). There exists /3c{p) G (0, +oo) such that for all j3 > Pdp) we 
have survival with positive probability for almost all realizations of the environment and for all /? < /3c{p) 
we have a.s. extinction for almost all realizations of the environment. Moreover p t-^ Pdp) is nondecreasing 
and limp_j.o /3c (p) = 0. 

The next example shows, that for a generic {fJ-p} pe{o,+oo) satisfying our hypotheses, we cannot always 
expect /32(p) = /3i(p). This means that the probability of survival does not need to be monotone with respect 
to (3. 

Example 4.4. Let us take A = (V2l + 3)/4, b = (%/2T- 3)/4, a = dn = dr = 1/2 and p = 1. Since p = 1 it 
is enough to consider the expected size of the persistent population ( at each killing time, susceptible bacteria 
are killed). We note that x+ = 1, = -1 andf{t) = e*(5- V^)/8 + e"*(3 + %/2T)/8. From equation K9^, 



7^ = r{t); moreover the only strictly positive solution of r{t) ~ 1 is = log(3 + \/2T) — log(5 — \/2T)- We 
have f(t) < 1 for all t G (0, Tc) and f{t) > 1 for all t > Tc. Consider the following family of measures 



M/3 



+ /3 e (15, +00) 



where is the Dirac measure at a G M. Roughly speaking, for any fixed /3, every time interval Ti is chosen 
independently between two values with probability 1/2 each. It is straightforward to see that the family 



{l^p} fieia. +00) is stochastically increasing and satisfies equation (4.8). According to Theorem 3.1] (: 



also Remark 5.2 for details) i/ E[log(f(ri))] < 1 there is a.s. extinction for almost every realization of the 
environment, while i/E[log(f(ri))] > 1 there is positive probability of survival for almost every realization of 
the environment. Here we have extinction if (3 is close to (take for instance, /3 — 0.5j, we have survival if 
/3 — 1, we have extinction again if /3 — 15 and we have survival if j3 is large (take for instance, (5 = IQ.b). 
Thus the probability of survival is not monotone and P'^(jp) < 1 < 15 < /3c(p). 



5. Proofs 

Proof of Theorem \3.1\ Define 

Ftjx) := - x((l - p)n{t) + r{t)) + (1 - p){n{t)r{t) ~ n{t)r{t)) 



b+dr+X+\ tx- f . b+dr+X-\\ . t(x++x-) (^'^^ 

l-p — — — +e*^ (l+P — — — + (1 - p)e*("^ 



where + x^ = A — 6 — df. — a — dn- Let > be the solutions of Ft^p{x) — 0. In order to check the 
inequality > 1 we study the difFerentiable function t — > for every fixed p e (0, 1]; in particular we 

look for the solutions of the equation = with respect to t. Clearly 7,| = 1 and the other solution of 



Fo^p{x) = is 7q" = 1 — p < 1. Using equations ( |5.9| ) and (2.2 ) we have ^Ft^p{l)\t=o = p{dr + 6) > 0. Hence 
there exists £ > such that Ft,p{l) > for all t G (0, e); thus, by continuity and since < 1, we have that 
< 1 for all t e (0,e). Since linit^oo Ft.pi^) = —oo for all p £ (0, 1], there is at least one strictly positive 
solution to Ft^p{l) = w.r. to t. In order to show that it is unique, observe that, since x^ < 0, 
d 

dt' 



;Ft,pil) = e*("++"") [(1 - p){x+ + X-) - (a;+e*l""l {1 ~ ph) - |x-|e-*"^ (1 + p{l - /i))) 



where h= {b + dr + x+)/{x+ - x-). Clearly sgn(^Ff,p(l)) = sgn{L{t, p)) where L{t,p) Ft^p(l)e~*(^ +^ > 
Since a;"'' > we have that (for every fixed p) 1 1-^ L{t,p) is a strictly decreasing function such that L{0,p) > 
and hiTit-f+oo L{t,p) ~ — oo; thus there exists a unique Tc — Tc{p) G (0, +oo) such that Ft^p{l) > 
(resp. Ft,p(l) <0) ift e {0,Tc) (resp. t e (Tc,oo)). This implies that 7^+ < 1 for all t e (0,Tc) and 7^+ > 1 
for all t e [Tc, +00) (clearly ^7-^(^) ^,(1) = and 7^ = 1). 

By elementary analysis p i—> Tp is a differentiable function (for every fixed t > 0). Moreover, by convexity, 
since {b + dr + x+)/{x+ - x^) e [0, 1], 

— Ft (1) ^ c*"^+ ^ + + I c*"'' b + dr + x- \ ^t(x++x-) 
dp x+ — x~ \ x+ ~ x^ J 

^ ^t[x+{b+dr+x''')/{x+-x-)~x-{b+dr+x^)/{x+-x-)) _ ^t{x++x~) 
^ ^t{x+ +x- +b+d^) ^t{x++x-) ^ Q 

for all t > 0. Hence p i~> Ff _p(l) is strictly increasing which implies that p 1— > Tc{p) is strictly increasing. Since 
hmp_j.o Ft^p{l) — Fi.o(l) < for alH > (indeed the process is supercritical in the absence of mass-killing), 
we have that limp_j.o T'c(p) — 0. 

Finally, if a > then there is survival starting from 1 persistent particle if and only if there is survival 
starting from 1 susceptible particle; thus, since the process is monotone with respect to the initial state, the 
long-term behavior is the same as long as the initial state is finite. If a = then p < 1 and the Perron- 
Frobenius eigenvalue x^ — TOii(i), hence our result holds starting from 1 susceptible particle; nevertheless, 
since 6 > 0, even if we start from 1 persistent particle there is a positive probability it becomes a susceptible 
one, hence there is a positive probability of survival starting from 1 susceptible particle if and only if there 
is a positive probability of survival starting from any finite initial state. □ 



The proof of the following Lemma is very easy, nevertheless we include it for completeness. 

9 



Lemma 5.1. Let {TijieN be nonnegative i.i.d. random variables. IfV{Ti > 0) > then E,[Nt] < +oo where 
Nt :=max{n: ELo^' <0- 



Proof. Let Sn Er=o ^nd suppose that E[T^^] < +oo: in this case define E[Ti] =: ^ > 0, E[(Ti-n)'^] =: cr^ 
and K[{Ti — /i)"*] =: r*. Clearly, eventually as n — ?> oo, 

V{Nt > n) = P{Sn < = P('5'„/n - H<t/n- fi) 

16 



< P(|5„/n - /i| > /i/2) < E[|5„/n - mI']/ W2)* 



E 



(*)■ 



Now (I]r=i('^»~A*))^ = I]ie{i,...,n}4 nj=i(^ij-M); moreover the independence of {T^jieN yields E[nj=i(Tij 
/i)] =0 if there exists j such that ij ^ for all k j. Hence 



(*) 



16 



E 



16 



thus E[7Vt] = E„eNlP(^t > < 

In the general case, define T,j min(rj, 1). Then E[T^] < +oo hence E[Nt] < E[Nt] < +oo where 
Nt :=max{n: EtoT^<t}. □ 

Remark 5.2. In the random killing time case we deal, in general, with a multitype branching process in 
random environment where the sequence of environments is i.i.d. hence, if we denote by Af„ := M{Tn) 



the first-moment matrix (3.7) with T = Tn, by Kingman Subadditive Theorem, we have (see for instance 

[HisiiHiiniiTn]; 



and Sp ~ lim„- 



lim n ^ log 

71— f oo 

iog(||nL„M 



Sp — E[(5^], a.s. 



where \\M\\ maxj J2^ \M^J \ and Mi := M„M„_i • • • Mi. 

This plays the role of the Perron- Frobenius eigenvalue of the deterministic case and it will be useful in the 
next proofs (where we use [131 Teorems 9.6 and 9.10]; in the case p = 1 one may use also [111 Theorem 3.1] 
instead). 

Moreover, it is easy to check that the conditions o/[131 Teorems 9.10] are satisfied. Indeed, the entries of the 
first-moment matrix satisfy mi j{t) > for all t > and for all i,j = 1, 2. Moreover, since fJ-i3{{0, +oo)) = 1 
for all P G (0, +oo), we have P(minij(Mi)i.j > 0) = 1. Finally, if we start with a susceptible particle then 
V{N{t) > 1) > e-(''+''")* hence 



E[|log(l-P(Ar(t) ==0))|] < / {a + dn)tpifi{dt) <+oo, V/3e(0,+oo). 

J(0,+oo) 

On the other hand, if the initial condition is a persistent particle we proceed by using R{t) instead of N(t). 
One can check analogously that our branching process in random environment is strongly regular (see [131 
Definition 9.1]). Hence, according to |13l Theorem 9.10], we have: 

(1) 5[j <Q implies a.s. extinction for almost all realizations of the environment, 

(2) > Q implies survival with positive probability for almost all realizations of the environment. 
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Clearly the probability of survival is if and only if the conditional probability of survival is for almost all 
realizations of the environment. On the other hand, since P{q{£,) = 1) is either or 1 (see Section^, then 
the probability of survival is strictly positive if and only if the conditional probability of survival is strictly 
positive for almost all realizations of the environment. 

Proof of Theorem\4.1\ First of all we check the integrability condition, that is, for all n > 1, 



E 



log (In 



Mi 



\og{\\[M{t,)f\\\[iip{dt,) < +CX), 



where 11"=! /^/3 ^ probability product measure on M". Below we show that if p < 1 then Hi^n 



> 



(1 — (for some e > 0) while if a > then nl=n ^'^i — ^" i^'^^ some £ > 0). Hence ifa + 1— p>0, 

for some e' > 0, 

/I n 
n'^iog- (II n^'^(*^)||) n^^(^*») - iog"(^') < +^ 

i—n i—1 

since log" is nonincreasing (where log~(-) :— max(0, — log(-))). Thus we just need to prove that 
/ ?^"^|log+ (||nL„^(^0||)|nr=iM/3(di^) < +00 (where log+(-) :^ max(0, log(-))). From equation ([2^1 
we have ||Af(t)|| < Ke*^ ; hence, since log^ is nondecreasing, || ni=n-^^i|| — lVi=i \\Mi\\ and the expected 
value of is finite (for all /3) we have / n^^ | log^ (|| Hi^n -^(^«)||) | I\i=i M^(dti) < +00. 

Suppose p < 1 and a > 0. For all t,T > there exists f3o{T,t) such that ^^([t, +00)) > 1 — r for all 
/3 > f3o{T,t). By continuity and compactness we have that, for some e > 0, 



M{t) > 



(l-p)e 
e 



Mo, Vi > 



where, by definition, A> B if and only if Aij > Bij. It is easy to show, by using equation (2.51, that there 
exists tp e [0, +00) such that 

/ .4 . n\ _ 

-■Ml, yt>tp. 



M{t) > { ^(1^ P) 



Let /? > /3o(l/2,tp) and {A/i},;>i the corresponding sequence of random first-moment matrices (Mi :— 
M{Ti)); thus, according to the Law of Large Numbers, with probability 1, as n 00, #{i < n: Mi > Mi} > 



i/2 which implies that Y[i=n ^'^i — M'^"^ m"^^ = 2"! almost surely. Hence liminf„ 



log 



M, 



> 



log 2 > a.s. which, according to 13, Theorems 9.10], implies survival with positive probability for almost 
every realization of the environment. Hence, by definition, l3i{p) < /3o(l/4, tp). 

The usual coupling technique shows that for any fixed choice of the parameters A, a, 6, c?„, d^ and for 
any realization of the environment, the probability of survival is nonincreasing with respect to p. Hence 
p I— > PKp) is nondecreasing. 

If p = 1 then a > and we are dealing essentially with a single population (the persistent bacteria as 

in [5]), since after each killing time we have just persistent bacteria left. The first moment, starting with 

a susceptible bacterium, is f{t). The proof is essentially the same since f(T) > e > for all t > and 

r{T) > 4/e for all t > tp. The result follows from [TT, Theorem 3.1]. Since a > then there is survival 

starting with a persistent bacterium if and only if there is survival starting with a susceptible one. 
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Finally if a = (hence p < 1) again we are dealing essentially with a single population: the susceptible 
bacteria. The first moment, starting with a susceptible bacterium, is n and the result follows (from 
Theorem 3.1] as before) from the inequalities n{t) > (1 — p)e for alH > and n{t) > 4/((l — p)e) for all 



t > t 



□ 



Proof of Theorem 4-2 If p = 1 and a = the process becomes extinct almost surely. We suppose henceforth 
that a + 1 — p > 0. Since log is increasing and {Mi}i>i are identically distributed, we have 

1 1 



E 



-ilog(||l]A^. 



iog(n 



<log(E[||Mi||]). 



Thus, if we prove that log(E[|l Afi ||]) < for every sufficiently small f3 then [HI Theorem 9.6] guarantees a.s. 
extinction for almost all configurations (if p = 1 one can also use ill. Theorem 3.1] instead). 

It is straightforward to show that t i-> ||M(t)|| is differentiable from the right at 0. By elementary 



computations, since A/(0) = 1, 4ilog\\AI{t)\ 



dt 



\Mit)\\ 



— m < 0. Hence, there exists io > 



such that log(|lA/(i)||) < ~tm/2 for all t e [0,io]- On the other hand, log{\\M{t)\\) < Cx+t for ah t > and 
some C > 0. Finally by equation (4.8), 

\ogi\\M{t)\\)^,pidt) ^ [ \og{\\^m\\)^,pidt)+ [ iog(|lAf(t)|i)M^(dt) 



(0,to] 



< 



tm 



(0,to] 



(to,oo) 



(to,oo) 

Cx+t^J,,3{dt) 



< - 



tm 



(0,to] 



2 '"'^H /.....I 



for every sufficiently small f3. Hence f32{p) > 0. 



As in the proof of Theorem 4.2 for every realization of the environment, the probability of survival is 
nonincreasing with respect to p. Hence p i— > (p) is nondecreasing. 
Let us fix /3 > 0. It is well-known that 

1 



hni n ^ log f II TT e^^' 



lim n 

n— >-oo 



x^Ei3 > 0, a.s. 



(e^^ is the maximum eigenvalue of e^). Moreover M{t) > (1 — p)e'^* thus Y[l=n — i'^ — p)"e'^^?=i and 



lim n ^ log 



> log(l — p) + x+E^ a.s. 



which is eventually strictly positive, as p — > 0. Hence, according to [13j Theorem 9.10] the process eventually 
survives as p — > 0; thus, by definition, /32(p) < /? eventually as p — ?> 0. 

□ 

Proof of Theorem \4.S\ We use a modification of the construction shown in [6]. Given /3i > /32, it is well- 
known that, by using the classical decimation procedure, it is possible to construct two sequences {T.i}i>\ 

2 . . 1 2 

and {Tj }j>i in such a way that, for every trajectory, {T^ (w) : i > 1} C {T^ (cj) : i > 1}. 
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Consider the binary tree T whose vertices arc the set V of finite words of the alphabet {0, 1} and whose 
root is the empty word 0. Every nonempty word viV2 . . . f„ is connected to its parent V1V2 ■ ■ ■ Vn-i and its 
two children V1V2 ■ ■ - VnO and V1V2 ■ ■ - Vnl (the root is connected to and 1). 

To each vertex v corresponds a variable ^(A) which represents the time interval between its birth 
and its splitting (when it gives birth). We assume that {Sy}i,^v is an i.i.d. family of random variables. 
Define := and, for every nonempty word v = Vi...Vn, Ty = Y^Zi Sy^,,,^^. Consider now the tree 
T on T X [0,+oo) as follows: the set of vertices is V := {{v,Ty),{v,Ty + Sy): v G T}. We have vertical 
edges between {v, Ty) and {v, Sy + Ty) (for all v G V); we have horizontal edges between {v, Ty + Sy) and 
each of its two children {vw,Ty + Sy) where w G {0, 1} (for all v G V). The vertical edge between {v,Ty) 
and {v,Ty + Sy) represents the time interval between the birth of the particle v and its splitting time. The 
horizontal edge between {v,Tv) and {vl,Tv) represent the birth of a child of v while we consider the other 
particle, namely vO, as v itself after giving birth. 

Independently of everything constructed so far, we consider four independent families of Poisson point 
processes {Wy}yev, {DDvev and {Dl}y^v on [0, +00) with intensities h, a, dn and dr respec- 

tively. Wc color the tree in white (susceptible state), red (persistent state) and black (dead particle) as 
follows: wc start with a white vertex (0, 0) and wc extend the color to the branches along the timeline until 
we reach a point of one of the Poisson processes. If wc meet a point and the current color is white we 
switch to black and there arc not modifications anymore in that subtree along the timeline (death of the 
particle), the same happens if we meet a point and the current color is red. If the current color is not 
black, then everytime we meet a Wy point we switch to red and everytime we meet a Wy point we switch to 
white. Black color is not modified when we meet new points in the Poisson processes. At every split point 
if the current color is white or black then we use the same color for the horizontal edges and we continue 
starting from the two new vertices. If the color is red then we use the same color for the horizontal edge 
which connects to the child whose name ends with (and we start again from there with a red vertex); we 
switch to black for the horizontal edge connecting to the other son (hence, the whole subtree branching from 
this vertex is black, since red (persistent) particles do not reproduce). 

So far we modelled the natural evolution of the system; now we add the action of the antibiotics. To 
this aim, independently again, we add the coupled Poisson processes {T^}i>i {j = 1,2) defined above and 
we consider two independent families of independent Bernoulli variables {Bl}^^y^ with parameter pi and 
{Bly^^y^. with parameter p2 where pi < p2 and VT is the set of vertical edges of T. There is an analogous 
decimation procedure which allows to couple these two Bernoulli processes in such a way that if Bl — 1 then 
B^ = 1. At each time (resp. T^) we consider all the white vertical edges intersecting the horizontal plane 
with time coordinate (resp. T^); for all such edges e, if Bj = 1 we switch to black in the corresponding 
J model (hence the whole subtree is black), otherwise nothing happens. 

In each model, at any time t > 0, let Nt (resp. Rt) be the number of white (resp. red) vertical edges which 
intersects the horizontal plane with time coordinate t; {{Ni, i?/)}(>o is the formal definition of the process. It 
is clear that the white/red edges in the second model have the same color in the first one, hence the non-black 
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portion of the tree in the second model is a subtree of the non-black portion of the tree in the first model. 
In this construction, the event of survival is the collection of all the trees which have at least a red/white 
branch intersecting the horizontal plane t for every t > 0. This implies easily that the probability of survival 
of a model is larger or equal than the probability of survival of a model {/32,P2) (where (5i > P2 

and p2 ^ Pi)- More precisely, we coupled the environments in such a way that the conditional (w.r. to the 
environment) probabilities of survival of the model are larger or equal than the conditional (w.r. to 

the coupled environment) probabilities of survival of the model {I^2tP2)- In particular, for any fixed p, the 
probability of survival is nondecreasing w.r. to /3 and, for any fixed /3, is nonincreasing with respect to p. 
If we define Pdp) ■= inf{/3 > 0: the process survives with positive probability} then Pdp) > (according 



to Theorem 4.2). Since the probability of survival is nondecreasing w.r. to /3, we have that for all /3 > l^dp) 



there is survival with positive probability and for all /3 < Pdp) we have almost sure extinction. Hence 



;(p) = sup{/3 > 0: the process dies out almost surely}, thus /3c(p) < +00 (according to Theorem 4.1) 



Clearly (3c{p) is nondecreasing with respect to p and, according to Theorem 4.2 limp_>.o (3cip) = 0. 

□ 
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